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Abstract.  Consider  a  continuous  distribution  on  [0,“)  with  cdf  F,  survival 
function  F  =  1-F  and  cumulative  hazard  function  H  =  -LnF.  For  F  NBUE  it 
is  shown  that  the  correlation  coefficient  between  X  ^  F  and  H(X)  is  bounded 
below  by  a/y,  the  coefficient  of  variation  of  F,  while  for  F  NWUE  the 
correlation  coefficient  is  bounded  below  by  y/o.  Several  applications  of  this 
inequality  and  its  generalizations  are  discussed,  including  Monte-Carlo  simula¬ 
tion  of  the  renewal  function,  exponential  approximation  of  DMRL  distributions, 
moment  inequalities  for  record  values  and  a  variance  inequality  for  random 
event  epochs  in  a  homogeneous  Poisson  process. 


i,  .*»  .V  k  v»» Suin'  »*•*  »*>  *-*  •-.»  *•■.§  *»<*  «•»*  ■*  ^ 


1.  Introduction  and  Summary. 

Consider  a  continuous  distribution  on  [O,00),  with  cdf  F,  survival 
function  F  =  1-F  and  cumulative  hazard  function  H  =  -LnF.  If  X  'v  F  then 
H(X)  is  exponentially  distributed  with  mean  1.  The  random  variable  H(X) 
measures  lifetime  by  total  hazard  overcome  until  death,  while  X  measures 
lifetime  in  ordinary  time  units.  Since  H  is  an  increasing  function  we  know 
that  H(X)  and  X  are  positively  correlated.  The  question  of  how  positively  corre¬ 
lated  arose  naturally  in  Brown,  Solomon  and  Stephens  (1981)  and  Brown  (1987)  in 
different  contexts.  In  the  former  paper  the  asymptotic  relative  savings  in 
risk  between  two  Monte-Carlo  estimators  of  the  renewal  function  was  given  by 
the  square  of  the  correlation  coefficient  between  X  and  H  00.  In  Brown 
(1987),  a  quantity  closely  related  to  the  correlation  coefficient  was  needed 
to  bound  the  distance  between  a  DMRL  (decreasing  mean  residual  life)  distribu¬ 
tion  and  its  stationary  renewal  distribution. 

In  this  paper  we  show  that  for  X  NBUE  (new  better  than  used  in  expectation) : 


(1.1) 


p (X,H(X) )  >  - 


while  for  X  NWUE  (new  worse  than  used  in  expectation) : 


U.2) 


P (X,H(X) )  >  £  . 


The  lc  /e-  bound  on  the  correlation  coefficient  also  aids  in  bounding  the 
expected  waiting  ti^e,  E(S9-S^),  between  the  first  end  second  record  values 
corresponding  to  an  i.i.d.  sequence  {X^,i  _>  1}  with  X^  'v  F.  Using  (1.1) 
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and  <1.2)  we  show  that  for  F  NBUE: 


(1.3) 


g2  <,  E(S2-S1)  £  a 

y 


and  for  F  NWUE: 


(1.4)  V  1  E^-Sp  <_  o. 

The  quantity  E(S2-S^)  represents  the  expected  time  to  failure  after  the 
first  minimal  repair,  and  is  of  Interest  in  the  study  of  maintenance  policies. 

In  section  3.4  inequalities  are  derived  for  the  moments  of  higher  record 
values.  For  example  it  is  shown  that  if  F  is  IFRA,  and  is  the  rC^ 

record  value  then: 


(1.5) 


<  ESk  < 
'i-i  -  r" 


-k+r-1. 

<  k  >uk 


where  y^  =  /xJdF(x). 

In  section  3.5  we  show  that  if  {T^.i  _>  1}  are  the  arrival  epochs  for  a 

homogeneous  Poisson  process  with  parameter  X,  and  N  is  a  stopping  time,  then 
_2 

Var  T„  >  X  .  We  further  show  that  among  all  distributions  with  failure  rate 
N  — 

uniformly  bounded  above  by  X,  the  exponential  distribution  with  parameter  X 
has  the  minimum  variance  for  the  kt^1  record  value,  for  k  >  1. 
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2.  A  Correlation  Inequality. 


Consider  a  non-negative  random  variable  X  with  continuous  cdf  F. 

ic  x  — 

Denote  by  X  a  random  variable  with  cdf  G(x)  =  p  /“  F(t)dt,  the  stationary 
renewal  distribution  corresponding  to  F.  Let  T  denote  a  random  variable 
with  distribution  dF^,(t)  =  tp  ‘''dF(t).  T  is  distributed  as  the  length  of 
the  interval  covering  an  arbitrary  fixed  point  in  a  stationary  renewal  process 
with  interarrival  time  distribution  F  (Feller  (1971)  p.  371).  Since  the 
backward  recurrence  time  for  a  stationary  renewal  process  is  distributed  as 
G,  we  see  that: 


(2.1) 


where  X  is  independent  of  X. 


T  ~  X|X  _>  X 


Next,  consider  the  record  value  process  corresponding  to  F.  We  take  an 

i.i.d.  sequence  {X^,  i  ^  1}  with  X^  F  and  define  =  X^, 

N2  =  {min  i:X±>  X^,  S2  =  Xj^  ,  Nfc  =  min{i:Xi  >  ),  Sfc  -  XR  ',  k=  3,4,...  . 

2  k-1  k 

The  sequence  {S^,  i  _>  1}  generates  a  non-homogeneous  Poisson  process  with 
EN(t)  =  -LnF(t)  =  H(t)  (Shorrock  (1972)).  Note  that: 


(2.2) 


s  ^  x|x  _>  X’ 


where  X'  is  independent  of  X  with  the  same  distribution. 

We  now  derive  a  useful  result.  Two  proofs  are  given,  as  each  is 
instructive. 

Lemma  2,1.  If  F  is  NBUE  (NWUE)  then  S2  is  stochastically  larger  (smaller) 
than  T . 
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Proof  1.  F  NBUE  is  equivalent  to  X  X  .  Now  Z(x)  =  x|x  _>  x  is  stochas¬ 
tically  increasing  in  x  (Pr(Z(x)  > t)  =  F(tVx)/F(x),  where  aVb  =  max(a,b), 
and  is  thus  increasing  in  x)  therefore  S£  =  Z(X)  is  stochastically 
larger  than  T  =  Z(X*)  (see  (2.1)  and  (2.2)).  The  NWUE  case  similarly  follows. 


Proof  2.  Consider  the  record  value  process  {S^,i  _>  1).  If  X  is 


NBUE  then 


E(Sk~Sk  ^)  <_  y,  thus  (S^-ny.n  1}  is  a  super-martingale. 

Consider  the  stopping  time  N  +1,  which  is  one  plus  the  number  of  record 
values  in  [0,t].  Then: 


(2.3)  ESn  +1  <  yE(Nt+l)  =  y(H(t)+l)  . 


Define  6  (t)  =  E(X-t|x>t)  =pG(t)/F(t).  Then  ESn  +1  =  t+6(t)  so  (2.3) 
reduces  to: 


(2.4) 


t+6 (t)  <  y(H(t)+l)  . 


Now: 


(2.5) 


F_  (t)  =  Pr (N(t)  <  1)  =  (H(t)+l)F(t) 
b2 


while : 


(2.6)  Fx(t)  =  Pr(T  >  t)  =  ty_1F(t) +G(t)  =  y_1F(t) [t+6 (t) ] 


The  result  now  follows  from  (2.4),  (2.5)  and  (2.6).  The  NWUE  is  handled 
analogously. 
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Lemma  2.2.  If  F  is  NBUE  then  p(X,H(X))  _>  o/y.  If  F  is  NWUE  then 
P (X,H(X) )  >  y/o. 

Proof.  Note  that  dF„  (t)  =  H(t)dF(t)  while  dF„(t)  =  ty  ^dF(t).  By 

b2  I 

Lemma  2.1: 


(2.7) 


ES2  =  E(XH(X) )  >_  ET  =  y2/y 


Now  subtract  y  and  divide  by  a  on  both  sides  of  (2.7)  and  the  NBUE  result 
follows. 

Next,  assume  that  X  is  NWUE.  It  follows  from  Lemma  2.1  that  for  any 
increasing  function  i  (with  the  expectations  existing): 


(2.8) 


e*(s2) 


Ux)H(x)dF(x)  <  y 


-1 


x£, (x)dF(x)  =  E£(T) 


choose  £(x)  =  H(x),  then: 


(2.9) 


EH2(X)  =  2  <  y_1E(XH(X)) 


From  (2.9)  the  NWUE  result  easily  follows. 


l»5 


I 

I 


Lcations. 


3.1.  Monte-Carlo  estimation  of  the  renewal  function.  Suppose  we  wish  to 

estimate  M(t),  the  expected  number  of  renewals  in  [0,t]  for  a  renewal 

process  with  interarrival  distribution  F,  by  Monte-Carlo  simulation.  An 

obvious  approach  is  to  simulate  N(t),  the  number  of  renewals  in  [0,t], 

K  times  (N^(t) , . . . ,NK(t) ) ,  and  to  estimate  M(t)  by  the  sample  mean. 

* 

In  Brown,  Solomon  and  Stephens  (1971)  an  unbiased  estimator  M  (t)  was 

proposed  and  it  was  shown  that  as  t  -*■  ®°  the  asymptotic  relative  savings 

in  risk  between  M  (t)  and  the  estimator  based  on  N(t)  was  given  by 
2 

p  (X,H(X)).  Lemma  (2.2)  gives  a  lower  bound  on  p  and  thus  a  lower  bound 
on  the  asymptotic  relative  savings  in  risk. 


3.2.  Exponential  approximation  of  DMRL  distributions.  Consider  a  continuous 
DMRL  (decreasing  mean  residual  life)  distribution  F  on  [0,°°)  with  stationary 
renewal  distribution  G.  In  Brown  (1987)  it  is  shown  that: 


(3.2.1) 


V*(F,G)  =  sup | F(B)-G(B) |  <  1-EH(X*) 


where  H  =  -LnF,  the  cumulative  hazard  function,  and  X  'v  G.  Now: 


(3.2.2) 


ES2  =  (H(t)+l)F(t)dt  =  p[l+EH(X*)] 


But  F  DMRL  implies  F  NBUE,  thus  (3.2.2)  and  Lemma  2.1  give: 


(3.2.3) 


thus: 


ES2  =  p [ 1+EH (X  )]  >  ET  =  u2/u 
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From  (3.2.1)  and  (3.2.4)  we  obtain: 

(3.2.5)  P*(F,G)  <  1—  (cr2/vi2)  . 

The  Inequality  (3.2.5)  thus  extends  the  result  of  Brown  (1987)  from  F 
IFR  to  F  DMRL.  Moreover  it  follows  from  (3.2.5),  employing  the  methodology 
of  Brown  (1987)  that  for  F  IMRL: 

(3.2.6)  sup|F(t)-e"t/lJ(  £  l-(a2/y2)  . 

Thus  if  F  is  DMRL  with  coefficient  of  variation  close  to  1,  then 
F  is  approximately  exponential. 

3.3.  The  second  record  value.  Consider  S2~S^  the  interarrival  time  between 
the  first  and  second  record  values  in  a  record  value  process  corresponding  to 
F  (equivalently  the  interarrival  time  between  the  first  and  second  events  in 
a  non-homogeneous  Poisson  process  with  EN(t)  =  H(t)  =  -LnF(t)).  It  follows 
from  Lemma  2.1  that  F  NBUE  implies: 

2 

(3.3.1)  E(S2-S1)  _>  ET-p  =  -7-  -  R  =  '-7- 

while  F  NWUE  leads  to  E^-S^  <_  (a2/p). 

The  quantity  E(S2~S^)  is  the  expected  residual  life  for  an  item  which 
is  minimally  repaired  at  its  first  failure.  It  is  of  interest  in  the  evalua¬ 


tion  and  planning  of  maintenance  policies 
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Lemma  3.3.1,  below,  presents  an  upper  bound  of  a  for  E(S2~S^),  I 

derived  without  aging  assumptions  of  F.  As  is  done  throughout  this  paper 
we  assume  that  F  is  a  continuous  distribution  on  [0,°°). 


2 

Lemma  3.3.1.  Let  X  ^  F  and  g  a  function  on  [O,00)  with  Eg  (X)  <  °°. 
Then: 


|E(g(S2)-g(S1))|  <  ag 


where  a  is  the  standard  deviation  of  g(X). 
S 

g(x)  =  x  gives: 


In  particular  the  choice 


E(S2-S1)  <  o 


where  a  is  the  standard  deviation  of  X. 

Proof.  Eg ( S 2 )  =  E(g (X)H(X) )  =  Eg(X)EH(X)  +  OgaR(x)p (g (X) ,H(X) )  <  Eg(X)+ag. 

Thus  E(g(S2)-g(S1))  <_  Substituting  -g  for  g  yields  E(g(S1)-g(S2) )  <_ 

a  from  which  the  result  follows.  (7 
8  u 

Corollary  3.3.1.  For  F  NBUE,  a2/u  <_  E^-S^  £  a.  For  F  NWUE, 

P  <  E(S2-S1)  j<  a. 


Proof.  The  NBUE  case  follows  from  expression  (3.3.1)  and  Lemma  3.3.1.  The 
NWUE  case  follows  from  Lemma  3.3.1  and  the  obvious  NWUE  inequality 
E(S2-S1)  .  □ 

Or  (x) 

A  function  g(x)  on  [0,°°)  is  defined  to  be  starshaped  if  —  is 
increasing  (meaning  non-decreasing).  If  g  is  non-negative  and  starshaped 


then  g  is  increasing. 


Consider,  now,  a  function  g  which  is  non-negative  and  starshaped  on 
[0,°°),  with  =  Eg(X)  <  Define: 

dFg(t)  =  g(t)dF(t)/nG  . 

Then:  dF  (t)/dFT(t)  =  y  ^y(g(t)/t)  which  is  increasing.  Thus  F  is 
larger  than  FT  under  the  partial  ordering  of  monotone  likelihood  ratio 
(Lehmann  [1959]  p.  73)  and  is  thus  stochastically  larger.  It  follows  that: 


(3.3.2)  E[Xg (X) ]  >  y  y  /y  . 

O  ^ 

Now  assume  that  F  is  NBUE.  By  Lemma  2.1  and  (3.3.2): 

(3.3.3)  Eg(S2)  >  Eg(T)  =  y_1E(Xg(X) )  >  ygy2/y2  . 


epoch  in  a  non-homogeneous  Poisson  process  with  EN(t)  =  H(t)  it  follows  that: 


(3.4.1) 


and  also  that: 


dF  (t)  =  [(H(t))K_-7(k-l):]dF(t) 


(3.4.2) 


dF  (t)  =  [H(t)/k-l)]dF_  (t),  k  >  2 

Sk  Sk-1 


Consequently  (from  3.4.2): 


(3.4.3 


Eg(Sk)  =  (k-l)'iE[g(Sk_1)H(Sk_1)]  . 


Now  H(Sk_^)  is  gamma  distributed  with  parameters  k-1  and  1  (the 
sum  of  k-1  i.i.d.  exponentials  with  parameter  1)  thus  ESj^  =  Var  Sk  1  =  k-1. 

Using  the  mean  and  variance  of  H(Sk_^),  (3.4.3)  and  the  upper  bound  for 
the  product  moment,  EUV  <_  EUEVK^o^  with  U  =  S^,  V  =  H(sk-1)  we  obtain: 


(3.4.4) 


Eg(Sk)  <  Eg(Sk_1)+(a(g(Sk_1))//k=I)  . 


From  (3.4.4)  we  obtain  the  following  generalization  of  Lemma  (3.3.1): 


(3.4.5) 


|e[ (g(Sk)-g(Sk_1)] I  <  a(g(sk_1))//k^l  . 


The  case  k=2  corresponds  to  Lemma  3.3.1.  However  the  more  general 
inequality  appears  to  be  computationally  useful  only  when  k=2.  For  general 
k  o(g(Sk_1))  is  no  easier  to  compute  than  E(g(Sk)-g(Sk_1) ) . 

We  have  no  analogue  of  Lemma  2.1  for  F  NBUE  or  NWUE.  However  if  we 
strengthen  the  restriction  on  F  from  NBUE  (NWUE)  to  IFRA  (DFRA)  then  we 


! 
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obtain  the  following: 


Lemma  3.4.2.  Let  F  be  a  continuous  IFRA  distribution,  and  T  be  a  random 
-  »  r 

variable  with  distribution  dFm  (t)  =  xr  aF(x)/p  ,,  where  p  is  the  in 

l  r-l  m 

r 

moment  of  F.  Then  is  stochastically  larger  than  and: 


<  Esk  <  (fc*r-1)uv 

“  r  —  k  k 


If  F  is  a  continuous  DFRA  distribution  with  finite  (r-l)st  moment  then  S 

r 

St 

is  stochastically  smaller  than  Tr«  If  in  addition  F  has  finite  (k+r-1) 
moment  then  the  above  inequality  reverses. 

For  r=2  the  above  inequalities  hold  under  the  weaker  condition  that  F 
is  NBUE  or  NWUE. 

1 

Proof.  Note  that  dFg  (t)/dFT  (t)  =  [H(t)/t]  which  is  increasing  as  F 

r  r 

is  IFRA.  Thus  Sr  is  larger  than  Tf  under  the  monotone  likelihood  ratio 
and  is  thus  stochastically  larger.  Thus: 


(3.4.6) 


ESk  >  ETk  =  p,  ./P  . 

r  —  r  k+r-1  r-1 


Next : 


(3.4.7) 


,.k  st  k 
£7  dF  >  —  dF 

k!  “  yk 


Multiply  both  sides  of  (3.4.7)  by  Hr  V(r-l)J  and  integrate  obtaining 


(3.4.8) 


.k+r-i.  _1_  k 

(  k  }  ~  ^  r  * 


i'/i'.V 


lc  V4«r  —  1 

Thus  ESr  <_  )  and  this  inequality  and  (3.4.6)  yield  the  IFRA  result. 

The  DFRA  case  similarly  follows.  By  Lemma  2.1,  for  F  IFRA  and  r=2, 
st 

S£  >  T2  *  T  which  is  sufficient  by  our  above  derivation  for  (3.4.6)  and 
(3.4.8)  to  follow  (with  r=2)  .  [] 

Note  that  the  various  inequalities  derived  above  for  record  value 
processes  hold  more  generally  for  non-homogeneous  Poisson  processes. 

3.5.  A  variance  inequality.  Consider  an  absolutely  continuous  distribution 

F  with  failure  rate  function  h(t)  bounded  above  by  X(h(t)  X  for  all  t  >_  0) . 
Let  and  S2  denote  the  first  two  record  values  in  a  record  value  process 

corresponding  to  F.  The  failure  rate  function  of  evaluated  at  t 

is  a  mixture  of  the  values  (h(s),s  >_  t)  and  is  thus  bounded  above  by  X  for 
all  t.  Consequently: 

(3.5.1)  E(S2-S1)  >.  X-1  . 

By  Lemma  3.3.1: 

(3.5.2)  E(S2-S1)  <_  o 

where  o  is  the  standard  deviation  corresponding  to  F.  From  (3.5.1)  and 

(3.5.2)  we  obtain: 

(3.5.3)  a2  >  X-2  . 


Thus  among  all  distributions  on  [O,00)  with  failure  rate  bounded  above 
by  X,  the  exponential  distribution  with  parameter  X  has  smallest  variance. 
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Next,  consider  a  homogeneous  Poisson  process  on  [O,00)  with  intensity 

X  and  event  epochs  {T^,i  1}.  Let  N  be  a  stopping  time  and  consider  the 

* 

random  variable  T^,  letting  h  denote  its  failure  rate  function.  Now: 


‘:S 


(3.5.4) 


h  (t)  =  XPr(T^=t  |T^=t,  for  some  i)  <_  X  . 


o  \ 

V*  V 


Thus  (3.5.3)  and  (3.5.4)  imply: 


(3.5.5) 


Var(TN)  <  X 


m 


Note  that  X  is  the  variance  of  as  well  as  the  variance  of 

^N(t)+1*  t*ie  c^me  first  event  after  time  t.  These  event  epochs  have 

smallest  variance  among  all  random  event  epochs  for  the  Poisson  process. 

The  inequality  (3.5.5)  holds  for  a  large  variety  of  random  variables 
arising  in  secondary  processes  generated  by  a  Poisson  process.  These  include 
counter  models,  queues  with  Poisson  input  and  unif ormizable  Marhov  chains. 

Also  note  that  if  the  failure  rate  of  F  is  uniformly  bounded  above  by 
X,  then  by  Lemma  3.3.1  and  the  argument  used  to  derive  (3.5.1): 


(3.5.6) 


i  *(sk+1-sk)  I  k'1/Z°<sk>  • 


1/2  -1 

Thus  a(S^)  >_  k  X  ,  the  lower  bound  being  achieved  in  the  exponential  case. 

Thus  for  k  1,  the  exponential  distribution  with  parameter  X  minimizes 
the  variance  of  the  kC^  record  value,  among  all  distributions  with  failure 
rates  uniformly  bounded  above  by  X.  Equivalently,  consider  a  non-homogeneous 


Poisson  process  with  intensity  function  X(t)  bounded  above  by  X.  Then 
_2  ^ 

Var  _>  kX  where  is  the  k  arrival  epoch.  Thus  among  all  non- 

homogeneous  Poisson  processes  with  intensity  functions  uniformly  bounded 
above  by  X,  the  homogeneous  Poisson  process  with  intensity  X  minimizes 
the  variance  of  S^,  for  all  k  _>  1. 
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